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ROBUST  HYPOTHF.STS  TESTING  WITH  BAND  MOnpi.S 
FOR  THE  PROBABILITY  DENSITIES 


Saleem  A.  Kassam,  Member,  IEEE 


Abstract 

Huber's  robust  probability  ratio  tests  for  classes  of  density  functions 
described  by  contamination  and  bounded  total-variation  models  are  extended 
for  band-models  for  the  densities.  A  connection  between  the  least 
favorable  (risk)  pair  of  densities  and  distance-measure  based  robustness 
Is  made  explicit. 

1.  INTRODUCTION 

In  [1],  Huber  developed  the  ideas  of  robust  tests  for  binary  hypothesis 
testing  problems.  Robust  tests  were  obtained  as  saddle  point  solutions  with 
respect  to  performance  criteria  based  on  the  risk.  Huber  was  mainly  interested 
in  classes  of  probability  measures  (under  the  two  hypotheses)  which  contain 
contaminated  nominal  probability  measures.  In  [1],  classes  of  probability 
measures  with  precribed  maximum  total- variation  from  nominal  measures  were 
also  considered. 


Here  we  will  show  that  we  can  extend  Huber's  analyses  for  the  contaminated 
nominals  classes  to  classes  of  density  functions  in  given  bands  of  density 
functions  lying  within  known  upper  and  lower  bounds  for  each  hypothesis.  We 
will  also  point  out  an  interesting  distance-measure  robustness  property  of 
the  least- favorable  pairs  of  probability  density  functions.  This 
property  connects  the  hypothesis-testing  results  to  recent  results  on  robust 
Wiener  filtering  by  Kassam  and  Lim  [ 2 ]  and  Poor  [ 3 ) ,  this  recent  work  having 
been  motivated  to  a  large  extent  by  the  usefulness  of  the  theory  of  robust  tests 
for  hypotheses. 
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It  should  be  noted  that  In  [4,5]  Kuznetsov  has  also  considered  hypothesis 
testing  with  similar  band-models  for  the  density  functions.  The  band-model  may 
be  more  useful  In  some  applications,  and  does  not  directly  Involve  the  notion 
of  s  nominal  density. 


2.  PROBLEM  DEFINITION 

Let  (O.A)  be  a  measurable  space  and  let  f  be  the  density  function,  with 
respect  to  an  arbitrary  measure  p  on  the  space,  of  a  probability  measure  P.  We 
consider  the  following  classes  F  ,F^  of  allowable  density  functions  under  the 
hypotheses  HQ,  Hj  respectively: 

F0  ■  {f  I  f0L  '  f  "  V  /fdU  “  11 


F1  '  {f  I  flL  '  f  ‘  flU  ffdU  “  1} 

Here  *QL»  fj^,  f^jj  are  non-negative  bounding  functions  which  are  such  that  Fq 

and  F  do  not  overlap,  with  f  ,  f  bounded  and  If  dp,  Cl  dp  <  1.  The 
1  OL  1L  J  OL  J  XL 

upper  bounds  are  possibly  extended-real-valued,  and J fQU  dp,  JV"  *  *• 

Let  $  be  a  test  for  FQ  vs.  F^  rejecting  F^^  with  probability  4k  (x)  when 
*  Eft”  is  observed,  and  let  L^  be  the  loss  incurred  in  falsely  rejecting  , 
i  «  0,1.  The  risk  function  R(f^,  <J>)  =■  Ef  i  *  0,1,  is  the  criterion 

of  interest  in  various  testing  problems  [1],  and  we  are  thus  interested  in 
obtaining  a  least-favorable  pair  of  densities  (gQ,  g^)  in  FQ  x  F^,  so  that 
R(fA>  4>)  £  R(g^,  $) ,  i  “  0,  1,  for  any  probability  ratio  test  for  gQ  vs.  g^. 

Mote  that  the  above  f^  denotes  an  arbitrary  element  of  F^. 

In  the  following  section  we  obtain  the  least-favorable  pair  (gQ,  g^>  using 
Huber's  techniques,  and  show  that  the  result  reduces  to  Huber's  when 
V  f^y  are  unbounded  everywhere. 
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3.  THE  LEAST- FAVORABLE  DENSITIES 


The  introduction  of  upper  bounds  fQ0,  f^  in  the  classes  of  allowable 
densities  results  in  a  modification  in  Huber's  solution  in  that  the  robust  test 
is  not  always  "censored"  at  constant  values.  The  specific  result  is  the  follow¬ 
ing  theorem. 

Theorem:  The  least-favorable  pair  of  densities  (gQ,  g^)  exists,  and  Is  defined 

by  one  of  either  (a),  (b) ,  (c)  or  (d)  below,  where  kQ,  k^ ,  k,  and  are 
constants: 


(a) 
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In  (c) ,  if  gQ  is  not  valid  with  -*■  0,  then 


arbitrary 


Proof :  The  proof  of  existence  of  a  solution  according  to  either  (a),  (b),  (c) 
(d)  is  outlined  in  the  Appendix.  To  prove  robustness  of  the  probability  ratio 
test  for  the  (gg,g^)  pair,  we  have  to  show  that  Huber's  Lenma  2  [1]  holds  in  our 
case.  We  illustrate  this  for  case  (a). 

As  In  [1],  we  have  to  show  that 

P.  {-£*<  t}  i  P  <--i<  t}  >  P  <  t}  >  P,  ^  <  t) 
f0  «0  80  80  81  80  fl  80 

for  any  real  t.  Suppose  k.  <  t  <  k  .  Then 
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Also, 


Similar  considerations  establish  the  condition  for  tik^  and  t'kj.  Robustness  of 
ths  probability  ratio  test  between  g^  and  g^  then  follows  directly  from  this  result  [1] 
Figure  1  Illustrates  the  form  of  the  least  favorable  pair  Ig^.gj)  for  a  simple 
example  where  (a)  In  Theorem  1  is  assumed  to  be  valid.  Note  that  we  get  Huber's 
result  for  the  c-contamtnation  classes  when  the  upper  bounds  tend  to  Infinity. 

4.  DISTANCE-MEASURES  ANT  ROBUSTNESS 

It  Is  reasonable  to  expect  that  the  pair  of  least  favorable  densities  we 
Its**  obtained  Is  the  pair  of  densities  "closest"  together  in  some  sense.  This 
Is  Indeed  the  case,  and  by  employing  the  general  formulation  of  a  distance- 
measure  between  two  hypotheses  given  by  All  and  Sllvev  [61  we  can  show  that  the 
l*sst  favorable  densities  are  the  closeat  pair  in  F^  x  F^,  For  probability  density 
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functions,  a  result  by  Blackwell  [7]  may  be  used  to  show  this.  This  result  was 
used  by  Poor  [3]  to  obtain  a  connection  between  robust  Wiener  filters  and  robust 
tests  for  hypotheses.  We  now  show  more  directly  that  the  least  favorable  pairs 
minimize  the  Ali-Silvey  distance  measure  over  x  F^. 

The  Ali-Silvey  distance  between  f^eF^  and  f^eF^  can  be  written  as 

d^.fj)  -  E0(C[Lf]} 

where  •  f^/f^  and' C  is  a  convex  function.  Note  that  the  expectation  is  a 
generalized  expectation  [6]  allowing  the  measure  corresponding  to  f^  to  have  a 
singular  component  relative  to  that  for  f^. 

We  consider  case  (a)  in  Theorem  1  to  illustrate  the  proof  of  the  statement. 
We  have 

d(f0.fi)-d(g0.gi>  -  Jf0C[Lf]  -  Jg0C[Lg] 

-  ff0{CtLf]-C[Lg]}+J(f0-g0)C[Lg] 

>  }f0C'lLg](Lf-I.g)  +J(f0-g0)CtLg] 

-  |(f0-8o)(cIv  -  Lgc’[L8])  +  j(fr8i)c'ILg1 

Now  is  non-negative  because  (C[L  ]-L  C'[L  ])  is 

J  u  u  8  8  8  8  8  8 

non- Increasing  with  Lg  and  because  of  the  definition  of  g^  in  different  sets 
according  to  (a).  Theorem  1.  Specifically, 

f(V*o)<clLg1‘Lgc,lLg1)  “  f<Vgo)(c[ki1-kic'lki1) 

-  0 
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because  whenever  L  <k,  we  have  f .-g„iO  and  whenever  L  >k,  we  have  f„-g„<0. 

fgl  00  g  1  00 

(f j~gj)C [L^JiO,  and  we  have  the  result. 

Exactly  the  sane  conclusion  Is  valid  for  the  least  favorable  spectral  densities 
for  robust  Wiener  filtering  [2,3).  Recently,  Poor  [8]  has  obtained  similar  re¬ 
sults  for  a  related  set  of  problems. 


5.  CONCLUSION 

It  has  been  shown  that  Huber's  robust  testing  results  can  be  extended  to 
classes  of  probability  density  functions  described  by  band-models,  wh^ch  do  not 
require  an  explicit  notion  of  a  nominal  density  function.  The  results  reduce 
to  Huber's  result  on  contaminated-nominal  density  classes  when  the  upper  bound 
becomes  large.  We  have  also  shown  a  direct  connection  between  these  results 
and  results  on  robust  Wiener  filters  through  a  consideration  of  distance- 
measures  over  the  classes  of  allowable  characteristics. 
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APPENDIX 

PROOF  OF  EXISTENCE  OF 
SOLUTION  IN  THEOREM 

Let  PqOIjj)  -  ^  and  P^k^  with  g^,  gg  defined  by  (a)  in  Theorem  1. 

The  Pq  and  are  continuous  functions,  P^  non-decreasing  and  P^  non-increasing. 

We  have  lim  Pn(k)<l;  let  lim  Pn(k)  -  a  .  Also,  lim  P.(k)<l  and  let  lim  P .  (k)  -  a  . 

k-0  k~>  0  k-»  1  k-*0 

If  •j>1  ar<f  •q>1,  the  solutions  k^.k^  always  exist.  If  k^>k^  or  if  one  or  both 

equations  P^(k)  -  1,  Pg(k)  ■  1  do  not  have  a  solution,  we  check  existence  of  (b) . 

Now  we  consider  the  solution  of  Pg(k)  +  A  ■  P^(k)  +  A/k  “  1.  The  first  equation 

requires  Pg(k)  -  P^(k)  -  A(l-k)/k.  This  equation  has  an  infinite  number  of  pairs 

of  solutions  (A,k),  and  one  of  these  will  also  be  a  solution  to  Pg(k)  •  1  -  A.  We 

then  check  if  a  solution  for  (gj»Rg)  for  these  values  A,k  can  be  obtained,  as  in  (b). 

Note  that  A,  A/k  have  to  be  less  than  unity  for  a  solution  to  be  possible.  We 
A 

would  get  £  ■  h. 

If  (b)  fails  to  give  a  solution,  we  consider  Qq(£q)  "  [gj  and  *  JgQ  in 

(c).  These  are  continuous  and  non-decreasing  and  non-increasing,  respectively.  If 
solutions  Cq  and  for  Qq(£q)  “  1  and  Q^(f^)  “  1  exist,  than  necessarily  we 
cannot  have  fg  "  k  ■  where  k  was  the  value  considered  above  lEq.  (1)].  If  (c) 
does  not  work,  a  solution  of  the  form  of  (d)  will  always  exist. 


Figure 


